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lOENTIPIERS >t(Learning Hierarchies 
ABSTRACT 

A 20-task learning hierarchy for subtraction of 
fractions was deductively derived using 6agne*s task analysis* To 
test this analysis eiipirically, conposite items were written for each 
level and administered to students in grades 3*6. Test results were 
analyzed by the Walbesser Technique and Puttern Analysis; ^he 
acceptance levels developed by Phillips and Kane were used 
criteria. These analyses yielded ratios for consistency, adequacy, 
and coipleteness which were below the acceptance level* The hierarchy 
was then revised to naxiiize these ratios, and an index of agreenent 
of .85 was obtained between the expected pattern of responses and the 
observed level* The investigators note that: (1) results nay have 
been affected by the fact that very few students were able to answer 
correctly items from the upper levels of the hierarchy; and (2) the 
study should be replicated using students with a broader range of 
abilities and ages* (SB) 
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DEVSLOPMSNT OP A LEARNING HIERARCHY 
FOR THE COMPUTATIONAL SKILLS OP RATIONAL 
NUMBER SUBTRACTION 

Patty L. Miller 
Pinellas County Schools 

E, Ray Phillips 
University of South Florida 

Many researchers have long recognized that 
sequence is a critical variable in learning (Ausubel, 
1963? Bruner, 1964? Gagne, 1965? Glaser, 1964? and 
Suppes, 1966) . The learner begins with simple tasks 
and progresses to increasingly complex tasks. Thus, 
the possibility of optimal instructional sequences is 
suggested. Gagne (1967) and Wang (1973) suggested that 
it would be pedagogically sound to construct a complete 
curriculum based on validated learning hierarchies. 
However, both Gagne (1968) and Pyatte (1969) have 
pointed out that the determination of this optimal or 
hierarchical sequence of subtasks from simplest to most 
complex is not a simple undertaking. 

A learning hierarchy constructed by task analysis 
alone may be incomplete. Empirical evidence must be 
obtained to verify or refute the hypothesized ordering 
of the subordinate subtasks in a deductively analyzed 
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hierarchy (Uprichard, 1970; Cox and Graham, 1966). 
The purpose of this study was to develop and analyze 
a learning hierarchy for the computational skills of 
rational number subtraction. 

PROCEDURE 

Using Gagne's tasK, analysis, a learning hierarchy 
for the computational skills of rational number sub- 
traction was constructed. This procedure yielded a hier- 
archy of 20 subtasks. Based upon the hypothesized order- 
ing of the subordinate tasks, a test was constructed to 
assess mastery «t each level in tihe hierarchy. In order 
to minimize chance or careless error a test format simi- 
lar to the "H-technique" (Stouffer, Borgatta, Hays, and 
Henry, 1952) was used. The test consisted of composite 
items for each level. Each composite item consisted of 
three items testing the same subordinate tasks. Pass was 
defined as correct responses to two of the three items at 
each level. The test was administered to 207 elementary 
school children from grades 3 through 6 in order to ob- 
tain a wide range of ability levels. Subjects were se- 
lected from schools integrated by busing. Thus, approx- 
imately one-third were black? the remaining two-thirds 
were mostly White with a small number of Spanish-Ameri- 



cans. 
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Patterns of responses for each transfer in the hier- 
archy were analyzed using both the Walbesser Technique (1968) 
and Pattern Analysis (Rimoldi and Grib, 1960) • Walbesser 
has developed a procedure for validating a hierarchically 
arranged sequence according to numerical criterion using 
the contingency table of pass- fail responses. The possible 
outcomes of the subtasks are represented using a binary 
scale. Ordered pairs designate performance on the sub- 
tasks: "1" representing acquisition of a subtask, "0" 
representing nonacquisition. The ordered pair (0,1) im- 
plies that the student failed the more complex task, but 
passed the simplest task. The ordered pairs (0,0), (1,1) 

i 

and (1,0) are defined similarly, Ai:ter scoring, a consis- 
tency ratio, an adequacy ratio, and a completeness ratio 
were calculated for each hypothesized relationship within 
the hierarchy. The consistency ratio is a measure of how 
consistent the data are with the hypothesized dependency. 
The adequacy ratio is a measure of the identified subordin- 
ate tasks. The completeness ratio is a measure of the 
effectiveness of instruction. The level of acceptability 
used for each of these ratios was that determined by 
Phillips and Kane (1973) instead of the levels proposed 
by Walbesser since no instructional sequences were 
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involved. The Phillips and Kane levels of acceptability 
ares (1) consistency ratio .85? (2) adequacy ratio .70? 
and (3) completeness ratio »50. 

The pattern analysis technique was used to analyze 
the responses for the complete hierarchy on a subject by 
subject basis. The index of agreement given by the pat- 
tern analysis indicates the amount of agreement or corre- 
lation between two patterns. In this case, the index of 
agreement indicates the agreement between the observed 
and expected patterns. If the tasks were truly hierarchi- 
cal, where each subtask was a necessary prerequisite to 
the next, once a learner failed a given level he would 
be iiixpected to fail all subsequent levels. Thus, the 
expected pattern was defined as one where no correct re- 
sponses followed an incorrect respon^^e. 

RESULTS 

The initial hypothesized hierarchy developed by task 
analysis is given in Appendix A. A computer program based 
on the Walbesser Technique was used to give the pass-fail 
response patterns between all relationships. That is, 
item 1 was paired with all 20 items? item 2 with all items? 
etc*? until all possible pairs of items were considered. 
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In order to empirically validate this hypothesized hier- 
archical sequence, the consistency, adequacy, and com- 
pleteness ratios for each relationship within the hier- 
archy were examined. No ordering of the 20 tasks yielded 
acceptable levels an all three ratios among all relation- 
ships in the hierarchy. The ordering which yielded the 
best fit to the data is shown in Table 1. 



TABLE 1 



Ratios for the Emoirical Order ina fN=207> 


Level 


Consistency 


Adequacy 


Completeness 


1-3 


.97 


.84 


.98 


3-5 


.92 


.71 


.83 


5-7 


.89 


.69 


.59 


7-2 


.95 


.57 


.77 


2-8 


.92 


.44 


.73 


8-4 


.92 


.52 


.58 


4-9 


.92 


.61 


.62 


9-6 


.70 


.82 


.51 


6-11 


.90 


.59 


.43 


11-10 


.75 


.68 


.30 


10-13 


.67 


.54 


.23 


13-17 


.88 


.45 


.14 


17-14 


.2a 


.77 


.13 


14-15 


.77 


.70 


.20 


15-12 


.47 


.86 


.25 


12-19 


1.00 


.22 


.13 


19-18 


.46 


.65 


.06 


18-20 


.62 


.33 


.05 


20-16 


.21 


.77 


.07 
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■The test based upon the hypothesized ordering of the 
subordinate tasks yielded an index of agreement of .81. 
After final revision, the empirical sequence yielded an 
index of agreement of .85 which indicates a higher agree- 
ment between the expected and observed response patterns. 
No statistical test of significance for the index of 
agreement has been developed. 

^e internal consistency of the test based on the 
initial hierarchy was determined using the Kuder- 
Richardson Formula 20 (Nunnally, 1967) . The value of 
this coefficient was .89. The pattern of responses of 
the empirical sequence was analyzed to determine if the 
ordering exhibited a hierarchical structure based on 
item difficulty. These results are given in Table 2. 

The percentage of subjects passing each of the 20 
items were arranged in descending order from .99 repre- 
senting test item number 1 to .08 representing item 
number 20. Inspection of these test scores indicated 
that items 9 and 12 were out of order. 
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TABLE 2 
Item Difficulty 



Item Difficulty 



1 


.99 


3 


.95 


5 


.91 


7 


.86 


2 


.75 


8 


.67 


4 


.60 


9 


.48 


6 


.59 


11 


.40 


10 


.43 


13 


.50 


17 


.33 


14 


.30 


15 


.28 


12 


.31 


19 


.16 


18 


.15 


20 


.11 


16 


.08 
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CONCLUSIONS AND DISCUSSION 

In interpreting the results of this study due 
consideration must be given to two sources of artifact. 

(1) a*he response patterns of students are affected by 
prior educational experiences. That is, in testing, if 
the student knows many of the items he will answer these 
correctly regardless of the order in which they appear. 

(2) It appears from the results of the item analysis 
that very few Ss responded correctly to items from the 
upper levels of the hierarchy. When dealing with conti- 
gency data, it is essential that a sufficient number of 

Ss respond correctly at all levels of the hierarchy. Thus, 
this study should be replicated with a larger sample 
over a wider range of ability and achievement l.evels. 

Levels in the hierarchy were rearranged based on 
Ss response patterns on the test items. Two major revi- 
sions involved items in which: (1) The answers required 
rewriting in simplest form. These items were found to 
be more difficult than those problems with mixed numerals 
which required finding a common denominator before the 
subtraction could be perfomred. However, this could simply . 
be a problem with reading and following directions. 
(2) It was found that writing equivalent fractions and 
expressing Whole numbers with mixed numerals were 



simpler tasks than subtraction items which did not 
involve the processes. That is, writing 2/3 as 4/6 
or 7 = 6 4/4 were simpler tasks than 3/4 - 1/4 « D • 
Also writing 7 as 6 4/4 was very simple by itself 
but became a much more complex task When encountered 
in a situation as 7 - 3 1/4 = D , 

Although the hierarchy was not validated according 
to criterion established, the index of agreement for the 
empirical sequence was greater than for the hypothesized 
sequence. Thus, one might conclude that for an entire 
sample of learners the empirical sequence would be the 
more optimal. 

Validated learning hierarchies can serve as useful 
models for instructional design, basis for development of 
diagnostic instruments, and a means for prescribing indivi- 
dualized instruction. Thus, further research should attempt 
to perfect techniques of hierarchy validation and deter- 
mine the effects of instructional sequences based on learn- 
ing hierarchies upon acquisition and long term retention. 
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Appendix A 
Identification of Hierarchy Cells 

Level Identification Example 

1 Subtracting with fractions having like 5. - 2. =j — | 
denominators where the difference is 7 7 
expressed in simplest form. 

2 Subtracting with fractions having like 
denominators where th« difference is 
equal to zero. 

3 Writing equivalent fractions by divid- 
ing the numerator and the denominator 
by the greatest common factor. 

4 Subtracting with fractions having like 
denominators, where the difference must 
be expressed in simplest form. 

5 Subtracting a whole number from a ra- 
tional number named by a mixed numeral. 

6 Subtracting with mixed nuiaerals having 
like denominators where the difference 
may or may not require writing in 
simplest form. 

7 Subtracting with mixed numerals where 
the difference is a whole number « 

8 Writing equivalent fractions by multi- 
plying the numerator and denominator 
by the same number. 

9 Subtracting with fractions where the 
lowest common denominator is the 
larger of the two given denominators 
and the difference may or may not re- 
quire rewriting in simplest form. 

10 Subtracting with mixed numerals where 
the lowest common denominator is the 
larger of the given denominators. 

11 Changing the name of a whole ri umber to a 
mixed numeral. 

12 Subtracting a number named by a mixed 
numeral from a whole number. 



1 
1 

4 


1 

" 4 " 




3 






6 


2 




3 


-1 = 




4 


4 


si 


_ 2 = 


1 1 


2 






5 — 
e 


■a 1 

R 

3 


_ |— -j 


9 1 
3 


-3 1 
3 




2 


_llJ 




3* 


" 15 




1^ 

10 


1 - 
5 




4 


-3 2- 
8 


=□ 


7 












5 


-2 i 
2 


=□ 
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Level Identification , Example 

13 Subtracting with fractions Where the i « i -.pi 
lowest common denominator is the pro- 2 5 ""^-^ 
duct of the given denominators and the 

difference may or may not require re- 
writing in simplest form, 

14 Subtracting with mixed numerals Where 5 1 «.2 ~ =1 — I 
the lowest common denominator is the 8 7 "* ' — ' 
product of the two given denominators. 

15 Subtracting with mixed numerals where 12 -i- -6 ^ = Fl 
the lowest common denominator is dif- 4 6 ' — ' 
ferent from given denominators and the 

difference is expressed in simplest 
form* 

16 Subtracting with mixed numerals Where 12 ~ -2 ~ «| — I 
the lowest common denominator is dif- 9 g ""L-i 
ferent from the given denominator and 

the difference must be expressed in 
simplest form. 

17 Changing the name of a mixed numeral 
in standard form to one which has an " 3 " 3 
improper fractional part (equivalent 

mixed numerals) . 

18 Subtracting with mixed numerals or 4 2 . ^ s-fl 
with a fraction from a mixed numeral 4 " 8 — 
where the lowest common denominator 

is a multiple of the two denominators 
and renaming an equivalent mixed 
numeral is required. 

19 Subtracting with mixed numerals or 11 — -7 — = I — I 
with a fraction from a mixed numeral 3 " 2 ' 
Where the lowest common denominator 

is the product of the two denominators 
and renaming an equivalent mixed nu- 
meral is required. 

20 Subtracting with mixed numerals or with 13 1 -2 ^ = I — | 
a fraction from a mixed numeral Where 6 8 ~ ' — ' 
the lowest common denominator is neither 

a multiple nor the product of the given 
denominators^ and renaming an equivalent 
mixed numeral is required. 
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